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DETAILED ACTION 



Information Disclosure Statement 

1 . The information disclosure statement filed 22 September 2004 fails to comply 
with 37 CFR 1 .98(a)(3) because it does not include a concise explanation of the 
relevance, as it is presently understood by the individual designated in 37 CFR 1 .56(c) 
most knowledgeable about the content of the information, of each patent listed that is 
not in the English language. It has been placed in the application file, but the 
information referred to therein has not been considered. 

Drawings 

2. The drawings are objected to as failing to comply with 37 CFR 1 .84(p)(4) 
because reference characters "2" in the specification [0018] and "12" in Fig. 1 have both 
been used to a designate display, such as a screen. Corrected drawing sheets in 
compliance with 37 CFR 1.121(d) are required in reply to the Office action to avoid 
abandonment of the application. Any amended replacement drawing sheet should 
include all of the figures appearing on the immediate prior version of the sheet, even if 
only one figure is being amended. Each drawing sheet submitted after the filing date of 
an application must be labeled in the top margin as either "Replacement Sheet" or "New 
Sheet" pursuant to 37 CFR 1.121 (d). If the changes are not accepted by the examiner, 
the applicant will be notified and informed of any required corrective action in the next 
Office action. The objection to the drawings will not be held in abeyance. 
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3. The drawings are objected to under 37 CFR 1 .83(a). The drawings must show 
every feature of the invention specified in the claims. Therefore, the image sensor 
disclosed in claims 45 - 55 must be shown or the feature(s) canceled from the claim(s). 
No new matter should be entered. 

Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in 
reply to the Office action to avoid abandonment of the application. Any amended 
replacement drawing sheet should include all of the figures appearing on the immediate 
prior version of the sheet, even if only one figure is being amended. The figure or figure 
number of an amended drawing should not be labeled as "amended." If a drawing figure 
is to be canceled, the appropriate figure must be removed from the replacement sheet, 
and where necessary, the remaining figures must be renumbered and appropriate 
changes made to the brief description of the several views of the drawings for 
consistency. Additional replacement sheets may be necessary to show the renumbering 
of the remaining figures. Each drawing sheet submitted after the filing date of an 
application must be labeled in the top margin as either "Replacement Sheet" or "New 
Sheet" pursuant to 37 CFR 1.121(d). If the changes are not accepted by the examiner, 
the applicant will be notified and informed of any required corrective action in the next 
Office action. The objection to the drawings will not be held in abeyance. 
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Claim Objections 

4. Applicant is advised that should claim 22 be found allowable, claim 24 will be 
objected to under 37 CFR 1 .75 as being a substantial duplicate thereof. When two 
claims in an application are duplicates or else are so close in content that they both 
cover the same thing, despite a slight difference in wording, it is proper after allowing 
one claim to object to the other as being a substantial duplicate of the allowed claim. 
See MPEP § 706.03(k). 

5. Applicant is advised that should claim 21 be found allowable, claim 25 will be 
objected to under 37 CFR 1 .75 as being a substantial duplicate thereof. When two 
claims in an application are duplicates or else are so close in content that they both 
cover the same thing, despite a slight difference in wording, it is proper after allowing 
one claim to object to the other as being a substantial duplicate of the allowed claim. 
See MPEP § 706.03(k). 

Claim Rejections - 35 USC § 101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

6. Claims 57 and 58 are rejected under 35 U.S.C. 101 because the claimed 
invention is directed to non-statutory subject matter. Claims 57 and 58 claim a 
computer program, however, since a computer program is merely a set of instructions 
capable of being executed by a computer, the computer program itself is not a process. 
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If the claims stated "A computer program stored on computer-readable medium", the 35 
USC § 101 rejection would be withdrawn. 

Claim Rejections - 35 USC §112 

The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

7. Claims 57 and 58 are rejected under 35 U.S.C. 112, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter 
that was not described in the specification in such a way as to reasonably convey to one 
skilled in the relevant art that the inventor(s), at the time the application was filed, had 
possession of the claimed invention. 

Referring to claim 57, the computer comprising code means is not supported by 
the written description. It is not mentioned in the written description other than claim 57. 

Referring to claim 58, the computer on a carrier carrying code is not supported by 
the written description. It is not mentioned in the written description other than claim 58. 
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Claim Rejections - 35 USC § 102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

8. Claims 1 - 44, 56 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Ono et al. (US Patent No. 5,588,097). 

In regards to claims 1, 2, 56 - 

Ono et al. discloses a system and method for determining three degrees of 
freedom for orientation. Referring to Fig. 1 , the graphic input apparatus of Ono et al. 
includes an input/output section (1) which includes a keyboard (4) and a table (5) which 
are used for inputting character and numerical information [column 2, lines 33 - 40]. 
The system also includes an image generating section (2) and figure rotation 
processing section (3) which are provided to the display screen (6) (claims 1, 56: a user 
interface) via a two-dimensional display device (9) (claims 1, 56: means for display) 
[column 2, lines 48 - 51]. The image generating section (2) includes a figure 
processing device (1 1) for generating, in the image generation mode, a three- 
dimensional figure based on the input information from the user (claims 1, 56: means for 
processing image data in order to display the data in the form of a 3D model) [column 2, 
lines 55 - 59]. 
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Figs. 5-9 specifies the respective three degrees of freedom for rotation. First, the 
center position of the object (21) being displayed on the screen (6) is automatically 
determined as a fixed point (step 41). If the user wants to select a point other than the 
object center as the fixed point, the user can specify such a point separately [column 4, 
lines 4 - 8]. Then, the user specifies one point on the spherical surface (22) displayed 
on the display screen (6) by pen (7) (step 43) (claims 1, 56: the means for processing 
acquires at least two points positioned in the 3D model via the user interface; claim 2: 
means for positioning an image acquisition system relative to an object) [column 4, lines 
22 - 23]. Depending on an instruction from the user, an axis connecting the center O of 
the spherical surface (22) and the first-input point P0 is also displayed (claims 1, 56: to 
deduce the positioning of an axis defined by the two points in the 3D model) [column 4, 
lines 39-41]. Referring to Fig. 6, the polar coordinates (# 0 ,O 0 ) of the starting point P 0 
being displayed on the spherical surface (22) are determined from its three-dimensional 
coordinates (step 61). The polar coordinates (<9, ,<D,)of the final input position P1 of a 
continuous trace have been made by the user on the spherical surface (22) user the 
pen (7) (step 63) are determined. The differences between the coordinates are 
calculated. These differences correspond to the variation of the posture of the object 
(21) in its initial state. Thus, the user can rotate the object (21) to a desired orientation. 
Upon completion of the input, the marker that was indicated at the first stage is erased, 
and the process returns to the initial state (step 67 - 69) (claims 1 , 56: reorient the 3D 
model such that the axis is in a predefined orientation relative to a plane of the means 
for display; claim 2: means implement positioning of the acquisition system to 
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correspond with an orientation of the model as displayed on the means for display), 
[column 5, lines 1 - 23]. 

In regards to claims 3, 11 - 22, 24, 25 - 

Referring to Figs. 8 and 9, a line segment OP1 connecting the point P1 that has 
already been inputted and the center O of the imaginary spherical surface (22) is 
regarded as the rotation of axis (step 81). Then, a point P2 on the spherical surface 
(22) that is inputted by the user is indicated by a marker as the rotation start point (step 
82). The user moves the pen (7) from the start point P2 in the direction of the desired 
rotation and then specifies another point P3 on the spherical surface (22), so that the 
angle P2P1P3 defines a rotation angle a (claim 3: means for orienting by controlling an 
angular position of the system to correspond with an orientation of the 3D model as 
defined on means for display) [column 5, lines 24 - 45]. The posture of the object (21) 
after it is subjected to the rotation is calculated by the projection conversion circuit (18) 
and the calculation results are displayed on the display screen (6) [column 5, lines 40 - 
46]. Thus, the single calculation provides a section view of the 3D model on a section 
plane which presents a predefined orientation relative to the axis indicated by the user 
since it shows one angle of orientation of the 3D model (claims 11-15: display of a 
section view of the 3D model on a section plane which presents a predefined orientation 
relative to the axis indicated by the user). By repeating the above operations, the user 
can rotate the object (21) in the desired direction (step 86) (claims 16 - 20: moves the 
section plan progressively under control from the user interface) [column 5, lines 46 - 
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48]. Furthermore, as the user rotates the object (21), i.e. moving the section plan in the 
3D model, the rotation angle a is kept constant (claims 21, 22, 24, 25: moves the 
section plane in the 3D model while keeping the section plane in a predefined 
orientation). 

In regards to claims 4 - 10, 23 - 

The data to be inputted by the user for the rotational operation includes 
components for the surface coordinates (i.e., polar coordinates) and a component for 
the rotation angle about an axis [column 3, lines 45 - 47]. When points P0 and P1 are 
the same point on the spherical surface (22), the object rotates about the axis (O-P0) by 
the rotation angle a by specifying point P0 and then determining points P2 and P3 
(claims 7-10: implements rotation of the 3D model about the axis defined by the two 
points indicated by the user) [column 3, lines 60 - 65]. Thus, by defining points P2 and 
P3 as P0, the angle of rotation a is zero resulting in a rotation around the O-P0 axis, 
i.e. parallel to the plane of the means for display (claims 4-6: orients the 3D in such a 
manner that the axis defined by the two points indicated by the user is parallel to the 
plane of the means for display; claim 23: predefined orientation of the section plane is 
orientated parallel to the axis indicated by the user). 

In regards to claims 26 - 44 - 

With reference to Figs. 5-9, the center position of the object (21) being displayed 
on the screen (6) is automatically determined as a fixed point (step 41). If the user 
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wants to select a point other than the object center as the fixed point, the user can 
specify such a point separately [column 4, lines 4 - 8]. Then, the user specifies one 
point on the spherical surface (22) displayed on the display screen (6) by pen (7) (step 
43) [column 4, lines 22 - 23]. If another point P1 is inputted immediately after the first 
point P0, it is determined that the axial rotation angle is going to be inputted (step 49) 
(claims 26 - 34: acquires at least three points positioned in the 3D model; claims 35 - 
44: acquires a plurality of points) [column 4, lines 49 - 54]. Depending on an instruction 
from the user, an axis connecting the center O of the spherical surface (22) and the 
first-input point P0 is also displayed [column 4, lines 39 - 41], as well as a line segment 
OP1 connecting the point P1 and the center O (claims 26 - 34: to deduce two axes 
therefrom each passing through a pair of points; claims 35 - 44: deduce a plurality of 
axes therefrom that are not all mutually parallel, each passing through a different pair of 
points selected from the plurality of points) [column 5, lines 30 - 32]. Since both points, 
i.e. P0 and P1 are x, y coordinates, it can be concluded that the axis formed with these 
points, i.e. O-P0 and 0-P1 , are parallel to the display (claims 26 - 34: reorient the 3D 
model in such a manner that the two axes are substantially parallel to the means for 
display; claims 35 - 44: reorient the 3D model bringing the set of the axes as close as 
possible to parallel with the plane of the means for display). 
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Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

9. Claims 45 - 55 are rejected under 35 U.S.C. 103(a) as being unpatentable over 

Ono et al. (US Patent No. 5,588,097) in view of Gillio (US Patent 5,704,791). 

Ono et al. teaches the limitations of claims 45 - 55 with the exception of disclosing 
physically orienting an image sensor relative to the final confirmed orientation. 
However, Gillio teaches a virtual surgery system where the user can simulate surgical 
procedures on a display and have a robot perform the same operation. 

Ono et al. discloses a system and method for determining three degrees of 
freedom for orientation. Referring to Figs. 8 and 9, a line segment OP1 connecting the 
point P1 that has already been inputted and the center O of the imaginary spherical 
surface (22) is regarded as the rotation of axis (step 81). Then, a point P2 on the 
spherical surface (22) that is inputted by the user is indicated by a marker as the 
rotation start point (step 82). The user moves the pen (7) from the start point P2 in the 
direction of the desired rotation and then specifies another point P3 on the spherical 
surface (22), so that the angle P2P1P3 defines a rotation angle a about axis OP1 (step 
83 and 84) [column 5, lines 24 - 45]. Next, the axial rotation angle is calculated by the 
axial rotation angle calculation circuit (18). The posture of the object (21) after it is 
subjected to the rotation is calculated by the projection conversion circuit (18) and the 
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calculation results are displayed on the display screen (6) [column 5, lines 40 - 46]. By 
repeating the above operations, the user can rotate the object (21) in the desired 
direction (step 86) [column 5, lines 46-48]. Upon completion of the input, the marker 
that was indicated at the first stage is erased, and the process is finished (step 87 and 
88) (claims 45 - 55: identifying a final orientation of the 3D model as confirmed by the 
user) [column 5, lines 45 - 48]. 

Gillio discloses a virtual surgery system based on image data. As shown in Fig. 1, 
the virtual surgery system includes computer (100), which includes a processor (102) 
and a memory(104). The virtual surgery system additionally includes a virtual scope 
handle mouse device (106) (claims 45 - 55: means for producing a command signal for 
physically orienting an image sensor relative to the user) [column 4, lines 15 - 24]. 
Image data is stored in memory (104) of the computer (100). Where the image data 
may be a three dimensional data set [column 4, lines 44-47]. Memory (104) may also 
store image data unrelated to or having no bearing on a human or animal anatomy. 
This image data may relate to particular volumes, shapes, sizes, textures, etc. [column 
4, lines 63 - 66]. As the user moves a virtual scope to traverse through an image space 
and perform virtual surgery in that image space, the computer or processor tracks 
where the endoscopic camera is, and what that camera is looking at [column 16, lines 
15-19]. Telesurgery may be used where a surgeon performs surgery form a distance. 
A robot can be used to simulate hand movements of the surgeon at the remote location 
via a tele-robotic unit. The robot can move the real endoscope or other surgical device 
according to the movements of the surgeon performed using a virtual scope (claims 45 
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- 55: physically orienting an image sensor relative to the user) [column 17, lines 13 - 
18]. 

Therefore, it would have been obvious to one of ordinary skill in the art to replace 
the graphics processor of Gillio with the image generating section that includes a figure 
processing device of Ono et al. so the physical model of the 3D model in 
correspondence with the 3D model on the display means of Ono et al. can be 
manipulated only once in accordance to the desired manipulation made on the display 
means of Ono et al., preventing unwanted orientation of the physical 3D model. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Chen (US Patent No. 5,019,809) 
Gotoh et al. (US Patent No. 5,956,045) 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michelle K. Lay whose telephone number is (571) 272- 
7661. The examiner can normally be reached on Monday - Friday, 7:00am - 4:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on (571) 272-7664. The fax phone number 
for the organization where this application or proceeding is assigned is (571) 273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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Examiner 
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